Partially Observable SDE Models for Image Sequence Recognition Tasks
نویسندگان
چکیده
This paper explores a framework for recognition of image sequences using partially observable stochastic differential equation (SDE) models. Monte-Carlo importance sampling techniques are used for efficient estimation of sequence likelihoods and sequence likelihood gradients. Once the network dynamics are learned, we apply the SDE models to sequence recognition tasks in a manner similar to the way Hidden Markov models (HMMs) are commonly applied. The potential advantage of SDEs over HMMS is the use of continuous state dynamics. We present encouraging results for a video sequence recognition task in which SDE models provided excellent performance when compared to hidden Markov models.
منابع مشابه
Performance of a Single Action Partially Observable Markov Decision Process in a Recognition Task
Partially Observable Markov Decision Processes (POMDPs) have been applied extensively to planning in environments where knowledge of an underlying process is confounded by unknown factors[3, 4, 7]. By applying the POMDP architecture to basic recognition tasks, we introduce a novel pattern recognizer that operates under partially observable conditions. This Single Action Partially Observable Mar...
متن کاملPerformance of a Single Action POMDP in a Recognition Task
Partially Observable Markov Decision Processes (POMDPs) have been applied extensively to planning in environments where knowledge of an underlying process is confounded by unknown factors[3, 4, 7]. By applying the POMDP architecture to a basic recognition task, we introduce a novel pattern recognizer that operates under partially observable conditions. This Single Action Partially Observable Ma...
متن کاملNo-Regret Methods for Learning Sequential Predictions Thesis Proposal
Sequential prediction problems arise commonly in many areas of robotics and information processing. For instance, in robot navigation tasks, autonomous robots rely on the ability to make a sequence of actions, given a sequence of observations revealed to them over time, in order to reach the desired goal location. Similarly, complex information processing tasks, such as structured prediction pr...
متن کاملPAC-Learning of Markov Models with Hidden State
Abstract. The standard approach for learning Markov Models with Hidden State uses the Expectation-Maximization framework. While this approach had a significant impact on several practical applications (e.g. speech recognition, biological sequence alignment) it has two major limitations: it requires a known model topology, and learning is only locally optimal. We propose a new PAC framework for ...
متن کاملCompleteness of Online Planners for Partially Observable Deterministic Tasks
Partially observable planning is one of the most general and useful models for dealing with complex problems. In recent years there have been significant progress on the development of planners for deterministic models that offer strong theoretical guarantees over certain subclasses of tasks. These guarantees however are difficult to establish as they often involve reasoning about features that...
متن کامل